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This  is  an  introductory  survey  of  integer  programming, 
its  theory,  methodology  and  applications,  for  the  Encyclopedia 
of  Statistical  Sciences. 
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INTEGER  PROGRAMMING 

by 

Egon  Bales 

A  linear  programndng*  or  nonlinear  programing*  prob¬ 
lem  whose  variables  are  constrained  co  be  integer,  is 
called  a  (linear  or  nonlinear)  integer  program,  We  will 
consider  here  only  the  linear  ease,  although  there  exist 
extensions  of  the  techniques  to  be  discussed  to  nonlinear 
Integer  progressing . 

The  Integer  programing  problem  can  be  stated  as 
(P)  nri.n{cx|Ax  >  b,  x  >  0,  x^  Integer,  J  iN^CH}, 
where  A  is  a  given  mxn  matrix,  c  and  b  are  given  vectors  of 
conformable  dimensions,  N  -  (l,...,n),  and  x  is  a  variable 
n-vector.  (P)  is  called  a  pure  Integer  program  if  •  N, 
a  mixed  integer  program  if  t  A  N^  #  N.  Integer  programming 
is  sometimes  called  discrete  optimization. 

Scone  and  Applicability 

Integer  programing  is  the  youngest  branch  of  mathe¬ 
matical  programming:  its  development  started  in  the  second 
half  of  the  fifties.  It  is  the  most  immediate  and  frequent¬ 
ly  needed  extension  of  linear  programing.  Integrality 
constraints  arise  naturally  whenever  fractional  values  for 
the  decision  variables  do  not  make  sense.  A  case  in  point 
is  the  fixed  charge  problem,  in  which  a  function  of  the 
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1*  Co  bo  minimized  aubjoec  co  linoor  constraints.  Such  a 
problem  con  bo  roscaeod  oa  an  lneogor  program  whonovor  x  Is 
bounded,  by  sotting 

c(xi>  "  Vi  +  Vi 

*1  -  °iyi*  •  0  or  1 

where  is  on  upper  bound  on  x^. 

By  far  eho  most  important  special  case  of  integer 
programming  is  the  0-1  programming  problem,  in  which  the 
integer-constrained  variables  are  restricted  to  0  or  1. 

This  is  so  because  a  host  of  frequently  occurring  non- 
linearities,  like  logical  alternatives,  implications,  pre- 
cedence  relations,  etc.,  or  combinations  thereof,  can  be 
formulated  via  0-1  variables.  For  example,  e  condition  like 
*  >  0  -  (f(x)  <  a  v  f(x)  >  b), 

where  a  and  b  ere  positive  scalara,  x  Is  a  variable  with  a 
known  upper  bound  M,  f(x)  is  a  function  whose  value  is 
bounded  from  above  by  0  >  0  and  from  below  by  L  <  0,  while 
Che  symbol  ,rv"  means  disjunction  (logical  "or"),  can  be 
stated  as 

x  <  M(1  -  Sz) 

f(x)  <  a  +  (U  -  a)6j,  +  (U  -  a)62 
f(x)  >  b  +  (L  -  b)6t  +  (L  -  b)(l  -  «2) 

4l’  fi2  *  0  or  1* 

A  linear  program  with  "logical"  conditions  (conjunc¬ 
tions,  disjunctions  and  Implications  involving  Inequalities) 
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Is  called  a  disjunctive  program,  since  It  is  the  presence 
of  disjunctions  that  makes  these  problems  nonconvex.  Dis¬ 
junctive  prog  retailing  is  coextensive  with  0-1  programing. 

Nonconvex  optimization  problems  like  bimatrlx  games, 
separable  programs  involving  piecewise  linear  nonconvex/ 
nonconcave  functions,  the  general  (nonconvex)  quadratic 
programming  problem,  the  linear  complementarity  problem 
and  deny  others  can  be  stated  as  disjunctive  or  0-1 
programming  problems. 

A  host  of  interesting  combinatorial  problems  can  be 
formulated  as  0-1  programing  problems  defined  on  a  graph. 
The  joint  study  of  these  problems  by  mathematical  pro¬ 
grammers  and  graph  theorists  has  led  to  the  recent  develop¬ 
ment  of  a  burgeoning  area  of  research  known  as  combinatorial 
optimization.  Some  typical  problems  studied  in  this  area 
are:  edga  fetching  and  covering,  vertex  packing  and 
covering,  clique  covering,  vertex  coloring;  set  packing, 
partitioning  and  covering;  Euler  tours;  Hamiltonian  cycles 
(traveling  salesman  problem). 

Applications  of  integer  programodng  abound  in  all 
spheres  of  decision  making.  Some  typical  real  world  prob¬ 
lem  areas  where  Integer  programming  is  particularly  useful 
as  a  modeling  cool,  include:  facility  (plant,  warehouse, 
hospital,  fire  station)  location;  scheduling  (of  personnel, 
production,  other  activities) ;  routing  (of  trucks,  tankers. 
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airplanes);  design  of  caominlea cion  (road,  pipeline,  tele¬ 
phone)  networks;  capital  budgeting;  project  selection; 
analysis  of  capital  development  alternatives.  In  statis¬ 
tics,  Integer  programing  is  useful,  for  instance,  in  ex¬ 
perimental  design,*  stratified  sampling,*  cluster  analysis.* 
Solution  Methods:  Overview 

We  denote  by  v(P),  and  call  the  value  of  (P),  the  op¬ 
timal  objective  function  value  for  (P).  We  denote  by  (L), 
and  call  the  linear  programming  relaxation  of  (P),  the 
linear  program  obtained  from  (P)  by  removing  the  integral¬ 
ity  requirements. 

Integer  programs  are  notoriously  hard:  in  the  language 
of  computational  complexity  theory,  the  general  0-1  pro¬ 
graming  problem,  as  veil  as  most  of  its  special  cases,  is 
NP-complete.  Polynomial  time  integer  programming  algor¬ 
ithms  do  not  exist.  However,  sometimes  an  Integer  program 
can  be  solved  as  a  linear  program;  l.e.,  solving  the  linear 
programing  relaxation  (L)  of  the  integer  program  (P) ,  one 
obtains  an  Integer  solution.  In  particular,  this  is  the 
case  when  ell  basic  solutions  of  (L)  are  Integer.  For  an 
arbitrary  Integer  vector  b,  the  constraint  set  Ax  <  b, 
x  >  0  is  known  (Hoffman  and  Krusfcai,  1958)  to  have  only 
Integer  basic  solutions  if  and  only  if  the  matrix  A  is 
totally  unimodular  (l.e.,  all  nonsingular  submatrices  of  A 
have  a  determinant  of  1  or  -1). 
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The  best  known  instances  of  total  unimodularity  are 
the  vertex-edge  incidence  matrices  of  directed  graphs  and 
undirected  bipartite  graphs.  As  a  consequence,  shortest 
path  and  network  floe  problems  on  arbitrary  directed 
graphs,  edge  matching  (or  covering)  and  vertex  packing  (or 
covering)  problems  on  bipartite  graphs,  as  well  as  other 
Integer  programs  whose  constraint  set  is  defined  by  the 
Incidence  matrix  of  a  directed  graph  or  an  undirected  bi¬ 
partite  graph,  with  arbitrary  integer  right  hand  side,  are 
in  fact  linear  programs. 

Apart  from  this  Important  but  very  special  class  of 
problems,  the  difficulty  in  solving  integer  programs  lies 
in  the  nonconvexlty  of  the  feasible  set,  which  makes  it 
impossible  to  establish  global  optimality  from  local  condi¬ 
tions.  The  two  main  approaches  to  solving  integer  programs 
try  to  circumvent  this  difficulty  in  two  different  ways. 

The  first  approach,  which  in  the  current  state  of  the 
art  is  the  standard  way  of  solving  Integer  programs,  is 
enumerative  (branch  and  bound,  implicit  enumeration).  It 
partitions  the  feasible  set  into  successively  smaller  sub¬ 
sets,  calculates  bounds  on  the  objective  function  value  over 
each  subset,  and  uses  these  bounds  to  discard  certain  sub¬ 
sets  from  further  consideration.  The  procedure  ends  when 
eech  subset  hes  either  produced  a  feasible  solution,  or 
was  shown  to  contain  no  better  solution  than  the  one  already 


In  hand.  The  bast  solution  found  during  Che  procedure  is  a 
global  optimum.  Two  early  prototypes  of  this  approach  are 
due  to  Land  and  Doig  (1960)  and  Balas  (1963,  English  ver¬ 
sion  1965) . 

The  second  approach,  known  as  the  cutting  plane  method, 
is  a  convexlficatlon  procedure:  it  approximates  the  convex 
hull  of  Che  sec  F  of  feasible  integer  points,  by  a  sequence 
of  inequalities  that  cut  off  (hence  the  term  "cutting 
planes")  parts  of  the  linear  programming  polyhedron,  with¬ 
out  removing  any  point  of  F.  Whan  sufficient  inequalities 
have  been  generated  to  cut  off  every  fractional  point 
better  chan  the  integer  optimum,  Chen  the  latter  is  found 
as  an  optimal  solution  to  the  linear  program  (L)  amended 
with  the  cutting  planes.  The  first  finitely  convergent 
procedure  of  this  type  Is  due  to  Gomory  (1958) . 

Depending  on  the  type  of  techniques  used  to  describe 
Che  convex  hull  of  F  and  generate  cutting  planes,  one  can 
distinguish  three  main  directions  in  this  area.  The  first 
one  uses  algebraic  methods,  like  modular  arithmetic  and 
group  theory.  Its  key  concept  is  that  of  subadditive 
functions.  It  Is  sometimes  called  the  algebraic  or  group 
theoretic  approach.  The  second  one  uses  convexity,  polar¬ 
ity,  propositional  calculus.  Its  main  thrust  comes  from 
looking  at  the  0-1  programing  problem  as  a  disjunctive 
program.  It  is  known  as  the  convex  analysis/disjunctive 
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programing  approach.  Finally,  eha  third  direction  applies 
to  combinatorial  programing  problems,  and  It  combines 
graph  theory  and  matroid  theory  with  mathematical  pro¬ 
gramming.  It  is  sometimes  called  polyhedral  combinatorics. 

Besides  these  two  basic  approaches  to  integer  pro¬ 
gramming  (enumeratlve  and  convexif ying) ,  two  further  pro¬ 
cedures  need  to  be  mentioned,  that  do  not  belong  to  either 
category,  but  can  rather  be  viewed  as  complementary  to  one 
or  the  other.  Both  procedures  essentially  decompose  (P) , 
one  of  them  by  partitioning  the  variables,  the  other  one  by 
partitioning  the  constraints.  The  first  one,  due  to 
Benders  (1962) ,  gets  rid  of  the  continuous  variables  of  a 
mixed  Integer  program  (?)  by  projecting  the  feasible  set  F 
into  the  subspace  of  the  integer-constrained  variables. 

The  second  one,  known  as  Lagrangean  relaxation,  gets  rid 
of  some  of  the  constraints  of  (P)  by  assigning  multipliers 
to  them  and  taking  them  into  the  objective  function. 

Each  of  the  approaches  outlined  here  aims  at  solving 
(P)  exactly.  However,  since  finding  an  optimal  solution 
tends  to  be  expensive  beyond  a  certain  problem  size, 
approximation  methods  or  heuristics*  play  an  increasingly 
important  role  in  this  area. 

Next  we  briefly  review  the  approaches  sketched  above, 
and  give  some  references  for  each  of  them.  As  general 
references  on  Integer  programming,  see  the  book  by  Garfinkel 
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and  Nemhauser  (1971),  and  che  recent  volumes  edited  by 
Chrlseofldes,  Mingo* zi,  Toth  and  Sandi  (1979),  Hammer, 
Johnson  and  Korea  (1979a,  b),  Padberg  (1980). 

Branch  and  Bound/ Implicit  Enumeration 

The  following  are  Che  basic  steps  of  a  typical  anumera- 
tive  algorithm.  Start  by  putting  (P)  on  the  list  of  sub¬ 
problems,  and  by  setting  v(P)  -  «,  where  v(P)  is  an  upper 
bound  on  v(P). 

1.  Choose,  and  remove  from  che  list,  a  sub problem 
(P^),  according  to  some  criterion  specified  by  the  search 
strategy.  If  the  list  is  empty,  stop:  if  no  solution 
was  found,  (P)  is  infaasible;  otherwise  che  current  best 
solution  is  optimal. 

2.  If  (Pj^)  has  constraints  involving  only  0-1 
variables,  explore  their  implications  via  logical  tests  to 
impose  as  many  new  constraints  of  che  type  *  0,  or 

xt  »  1  (or  of  a  more  complex  type),  as  possible.  If  as  a 
result  (P^)  is  shown  infeasible,  discard  (P^)  and  go  to  1. 

3.  Generate  a  lower  bound  v(P^)  on  v(P^),  by  solving 
some  relaxation  of  (P^)  (like  che  linear  programing 
relaxation,  or  a  Lagrangean  relaxation,  or  either  of  these 
two  amended  with  cutting  planes).  If  v(P^)  >  v(P),  discard 
(P^)  and  go  to  1. 

4.  Attempt  to  generate  an  Improved  upper  bound  on 
v(P)  by  using  some  heuristic  to  find  an  improved  feasible 
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solution.  If  successful,  update  v(P)  sad  remove  from  the 
list  all  (Pj)  such  that  v(P^)  >  v(P). 

5.  Split  (P^)  Into  two  or  more  subproblems  by 
partitioning  its  feasible  set  according  to  some  specified 
rule.  Add  the  new  subproblems  to  the  list  and  go  to  1. 

The  search  strategies  that  can  be  used  In  step  1  range 
between  the  two  extremes  known  as  "breadth  first"  (always 
choose  Che  most  promising  subproblem,  i.e.,  Che  one  with 
smallest  v(P^),  and  "depth  first"  (always  choose  one  of  the 
new  subproblems  just  created).  The  first  approach  carries 
a  high  cost  in  terms  of  storage  requirements,  therefore  the 
second  one  Is  preferred  in  most  codes.  Flexible  Inter¬ 
mediate  rules  seem  to  give  the  best  results. 

The  branching,  or  partitioning,  rule  of  step  5,  is 
usually  a  dichotomy  of  the  form 

\  <  l\i  v  \  >'\[> 

where  x^  is  some  integer-cons trained  variable  whose  value 
x^  in  the  current  solution  to  (P^)  is  noninteger,  while  ia| 
and  Tal  denote  the  largest  integer  <  a  and  the  smallest 
integer  >  a,  respectively.  The  choice  of  the  variable  is 
important,  but  no  reliable  criterion  is  known  for  it. 
"Penalties"  and  "pseudo-costs"  try  to  assess  the  change  in 
v(P^)  that  will  be  produced  by  branching  on  x^,  with  a 
view  of  providing  a  choice  that  will  force  the  value  of  at 
least  one  of  the  new  subproblems  as  high  as  possible. 


In  problems  with  some  scruccure,  more  efficient  breach¬ 
ing  rules  ere  possible.  la  Che  presence  of  e  "multiple 
choice"  coas ermine 

£  x  -  1,  x  -  0  or  1,  jeQ, 

J*Q  J  J 

for  instance,  one  can  branch  on  the  dichotomy 

•  0,  jsQj  v  £  Xj  -  1,  Xj  -  0,  j «Q\QX 

J«Qi 

for  some  Q^CQ,  thus  fixing  severe!  varlebles  ee  e  time. 
Other,  more  sophisticated  branching  rules  have  been  used 
for  set  covering,  set  partitioning  end  traveling  salesmen 
problems. 

The  logical  tests  of  step  2,  and/or  associated  In¬ 
equalities,  whenever  applicable,  were  shown  to  substan¬ 
tially  speed  up  Che  procedure.  However,  by  far  the  most 
important  ingredients  of  any  enumeracive  procedure  are  the 
bounding  devices  used  In  steps  3  end  4.  Dramatic  Improve¬ 
ments  were  registered  In  Che  case  of  such  special  struc¬ 
tures  like  Che  traveling  salesman  problem,  where  the  know¬ 
ledge  of  deep  cutting  planes  (usually  facets  of  the  convex 
hull  of  F)  has  made  it  possible  to  replace  the  common  lin¬ 
ear  programming  relaxation  (L)  by  a  much  "stronger”  one, 
either  by  amending  (L)  with  cutting  planes  of  the  latter 
type,  or  by  taking  those  same  cutting  planes  into  Che  objec¬ 
tive  function  In  the  Lagrangean  manner.  In  either  case, 

Che  resulting  vastly  enhanced  lower  bounding  capability  has 
drastically  reduced  computing  times.  Similarly,  Improve- 
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manes  la  eh*  upper  bounding  procedure,  Ilk*  Che  us*  of  *n 
•fflelcac  heuristic  Co  find  feasible  soludons,  were  found 
to  efface  decisively  Che  performance  of  breach  end  bound 
methods.  For  surveys  of  chls  eree  see  Bales  (1975),  Beale 
(1979),  Spielberg  (1979). 

Partitioning  Che  Variables  or  Constraints 
Benders’  partitioning  procedure  Is  based  on  Che 
following  result.  Consider  Che  problem 
(P^)  oin{cx  +  dy}Bx  +  Dy  ■  b,  x  >  0,  y  sQ} 
where  B  and  0  are  mxp  and  mxq  matrices,  respectively,  c,  d 
and  b  are  vectors  of  conformable  dimensions,  while  Q  Is  an 
arbitrary  see  (for  Instance,  the  set  of  integer  q- vectors) 
such  chat  for  every  ycQ,  there  exists  an  x  >  0  satisfying 
Bx  +  Dy  -  b.  Let  U  •  [u[uB  <  c},  and  let  vert  0  be  the 
(finite)  see  of  vertices  of  the  polyhedron  U.  Then  (P^ 
is  equivalent  Co 

(Pj)  min(wolwo  >  (d  -  uD)y  +  ub,  u  c  vert  U,  ycQ}, 
in  the  sense  that  If  (x,  y)  solves  (P^,  then  y  solves  (P^) ; 
and  If  y  solves  (.7^),  there  exists  an  x  such  that  (x,  y) 
solves  (P^).  Although  the  inequalities  of  (P^)  usually  out¬ 
number  thoae  of  (P^)  by  far,  they  can  be  generated  as  needed 
by  solving  a  linear  program  in  the  continuous  variables  x, 
or  Its  dual  (the  latter  having  U  as  its  constraint  set). 

This  approach  can  be  useful  in  particular  when  B  has  a 
structure  making  it  easy  to  solve  the  linear  programs  thac 


provide  the  constraints  of  (Pj). 

The  second  type  of  decomposition  procedure,  Lagrangean 
relaxation,  partition*  tha  aat  of  constraints  Ax  >  b  of  (P) 
into  A^x  >  and  A^x  >  b^,  and  formulates  the  Lagrangean 
problaa 

L(u)  »  mln((c  -  uAj)*  +  ubjlA^x  >  b^,  x  >  0,  x^  integer, 
Js^CM}. 

For  any  u,  L(u)  is  a  lower  bound  on  the  objective 
function  value  of  (P).  The  problem  in  the  variables  u  of 
maximising  L(u)  subjact  to  u  >  0  is  sometimes  called  the 
Lagrangean  dual  of  (P).  There  are  several  methods  for 
maximixing  L(u)  as  a  function  of  u  >  0,  one  of  them  being 
subgradient  optimisation.  If  u  >  0  maximises  L(u)  and  x 
is  a  minimising  vector  In  L(u),  then  x  is  an  optimal  solu¬ 
tion  to  (P)  if  AjX  >  b^  and  u(A^x  -  b^,)  *  0.  However,  this 
is  usually  not  the  case,  since  L(u)  and  the  optimal  objec¬ 
tive  function  value  of  (P)  tend  to  be  separated  by  a  so- 
called  duality  gap.  Nevertheless,  since  calculating  tha 
value  of  L(u)  for  fixed  u  may  be  a  lot  easier  than  solving 
(P),  this  is  often  a  convenient  way  of  generating  good 
lower  bounds. 

In  particular,  since  A^z  >  b may  consist  partly  (or 
wholly)  of  cutting  planas,  this  is  one  way  of  using  the 
latter  without  vastly  increasing  the  number  of  Inequalities 
explicitly  added  to  the  constraint  set.  For  surveys  of 
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these  techniques  see  Geoff rion  (1974),  Sheplro  (1979), 
Fisher  (1981). 

Cutting  Plane  Theory 

A  central  problem  of  Integer  programming  theory  is  to 
characterize  the  convex  hull  of  F,  the  set  of  Integer 
points  satisfying  the  Inequalities  of  (P).  F  Is  called  the 
feasible  set.  Its  convex  hull  (defined  as  the  smallest 
convex  set  containing  F)  is  denoted  conv  F.  From  a 
classical  result  of  Weyl  (1935),  It  Is  known  that  conv  F 
is  the  Intersection  of  a  finite  number  of  linear  In¬ 
equalities.  In  ocher  words,  (P)  is  equivalent  to  a  linear 
program.  Unfortunately,  however,  the  constraint  sec  of 
this  linear  program  is  In  general  hard  to  Identify.  Only 
for  a  small  number  of  highly  structured  combinatorial 
optimization  problems  do  we  have  at  this  time  a  linear 
characterization  of  conv  F,  i.e.,  an  explicit  representa¬ 
tion  of  conv  F  by  a  system  of  linear  inequalities.  In  the 
general  case,  all  chat  we  have  are  some  procedures  to 
generate  sequences  of  Inequalities  that  can  be  shown  to 
converge  to  such  a  representation. 

One  way  to  solve  the  general  integer  program  (P)  is 
thus  to  start  by  solving  (L),  the  linear  programming 
relaxation  of  (P),  and  then  to  successively  amend  the 
constraint  sec  of  (L)  by  additional  inequalities  (cutting 
planes),  until  the  whole  region  between  the  optimum  of  (L) 
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sad  that  of  (P)  1»  cut  off.  How  much  work  is  involved  in 
this,  depends  on  the  strength  (depth)  of  the  cuts,  ss  well 
es  on  the  size  of  the  region  thet  is  to  be  cut  off,  i.e., 
the  sire  of  the  gep  between  v(L)  end  v(P),  the  value  of  L 
end  P.  This  gap  can  be  very  large  indeed,  as  evidenced  by 
a  recent  result  for  the  class  of  0-1  programs  called 
(unweighted)  set  covering  problems  (where  all  entries  of 
A  are  0  or  1,  and  all  entries  of  b  and  c  are  1).  For  a 
set  covering  problem  in  n  variables  and  an  arbitrary  number 
of  constraints,  the  ratio  v(P)/v(L)  is  bounded  by  j 
for  n  even,  and  by  j  ^  ^  tot  0  °^*  Furthermore, 

t-hia  is  a  best  possible  bound . 

Am  to  the  strength  of  various  cutting  planes,  it  is 

useful  to  address  the  question  from  the  following  angle. 

Let  F  CBn,  d  e*tt  and  docK.  The  set  [x  c  conv  F|dx  -  dQ} 

is  called  a  facet  of  conv  F,  if  dx  >  do  for  all  x  c  F  and 

dx  »  d  for  n  affinely  independent  points  x  c  F.  In  the 
o 

integer  programming  literature  the  inequality  dx  >  dQ 
defining  the  facet  is  also  called  a  facet.  Facets  are 
Important  because  among  many  possible  representations  of 
conv  F  in  terms  of  inequalities,  the  facets  of  conv  F  pro¬ 
vide  a  minimal  one.  Obviously,  they  are  the  strongest 
possible  cutting  planes. 

Subadditive  cuts 

Consider  the  integer  program  (P),  with  •  N. 
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Solving  eh*  lln**r  programing  relaxation  (L)  of  (P)  pro¬ 
duces  a  simplex  tableau  of  the  form 

<»  *1  ’  £  V'V  1,1 

where  1  end  J  are  eh*  index  sets  of  basic  and  nonbaslc 
variables  respectively.  If  a^  is  noninteger  end  w*  denote 
f^j  •  a^j  -  l^jJ*  ^  1*  Jt  one  can  show  that  (1)  together 
with  the  integrality  of  the  variables,  implies  for  every 
lei, 

«>  Vi  2  V 

The  inequality  (2)  is  a  cutting  plane,  since  it  is 
satisfied  by  every  integer  x  that  satisfies  (1),  but  is 
violated  for  instance  by  the  optimal  solution  to  (L) 
associated  with  (1),  in  which  ell  nonbaslc  variables  are 
equal  to  0.  This  cut  was  the  basis  of  Gomory* s  method  of 
integer  forme,  the  first  finitely  convergent  cutting  plane 
algorithm  for  pure  integer  programs.  An  analogous  cut 
provides  a  finitely  convergent  algorithm  for  mixed  integer 
programs  (vith  integer-constrained  objective  function  value). 

The  derivation  of  the  cut  (2)  is  baaed  on  simple 
modular  arithmetic.  However,  the  Integer  program  over  the 
polyhedral  cone  defined  by  (1),  together  with  the  condi¬ 


tions 


(3)  Xj  integer,  jsIUJ;  >  0,  J  *  J 

(not*  chat  the  conditions  x^  >  0,  j  cl  are  omitted),  is 

equivalent  to  an  optimization  problem  over  a  commutative 
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abelian  group,  that  can  ba  solved  aa  a  shortest  path  prob- 
laa  (Gooory,  1969).  Whenever  tha  vactor  x  corras  ponding  to 
tha  op etna 1  solution  found  for  tha  group  problaa  satisflas 
tha  condltlona  Xj  >  0,  J  at,  it  la  an  optimal  aolutlon  to 
(P).  Whan  thla  la  not  tha  easa,  x  provides  a  lovar  bound 
on  v(P). 

Tha  key  eoneapt  In  Gooory 's  characterization  of  tha 
"eornar  polyhedron",  l.a. ,  tha  convex  hull  of  lntagar  points 
In  tha  above  nantlonad  eona,  la  subaddltivity.  This  has 
subsequently  lad  to  a  subaddltlva  charaetarlzatlon  of  tha 
convax  hull  of  F  ltaalf. 

A  function  f  daflnad  on  a  monoid  (semigroup)  M  Is  sub* 
additive  If  f (a  +  b)  <  f(a)  +  f(b)  for  all  a,  biM.  Lat  A 
ba  an  mxn  matrix  with  rational  antrlaa,  lat  a^  ba  tha  jCh 
column  of  A,  and  lat  X  ■  {x|Ax  •  b,  x  >  0  lntagar  ]  )*  0. 

Than  for  any  subaddltlva  function  f  on  tha  monoid 
**  ■  (fIf  ■  Ax  for  soma  lntagar  x  >  0},  such  chat  f(0)  »  0, 
tha  inequality 
n 

(4)  Z  f(a.)x,  >  f (Ax) 

J-i  3  3 

la  saelafled  by  every  xcX.  Conversely,  all  valid  In¬ 
equalities  for  X  are  dominated  by  aa  Inequality  (4)  for 
some  subaddltlva  function  f  on  M  such  that  f(0)  •  0.  For 
literature  sea  Johnson  (1974,  1980),  Jeroslow  (1979). 
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Disjunctive  cuts 

A  different,  geometrically  mo civs  cad  approach  derives 
cutting  planes  from  convexity  considerations  (intersection 
or  convexity  cuts,  disjunctive  cuts).  This  approach  is 
directed  primarily  to  the  0-1  programming  problem.  As 
mentioned  earlier,  0-1  programing  is  coextensive  with  dis¬ 
junctive  programing,  and  the  best  way  of  describing  the 
approach  is  by  applying  it  to  the  disjunctive  program 

(D)  min  (ex  |  V  (Atx  >  b1,  x  >  0)}. 

1«Q  .  . 

Here  Q  is  an  index  set,  A  and  b  are  m^Xn  and  m^xl 
matrices,  and  "V"  means  that  at  least  one  of  the  systems 
aSc  >  b ,  x  >  0,  must  hold.  This  is  the  disjunctive  nor¬ 
mal  form  of  a  constraint  set  Involving  logical  conditions 
on  inequalities,  and  any  such  constraint  set  can  be  brought 
to  this  form. 

The  convex  hull  of  a  disjunctive  set  is  characterized 

by  the  following  two  results.  Let  the  set  be 

F  -  [xl  V  (Alx  >  bl,  x  >  0)}, 

1  i 

where  A  ,  b  ,  1  c  Q  are  as  above,  and  let  Q*  be  the  set  of 
those  1  cQ  such  that  the  system  A*x  >  b1,  x  >  0  is  consis¬ 
tent.  Let  or  e  3Ra  end  «  iS,  Then  the  inequality  a  x  >  a 
is  satisfied  by  every  x  «  F  if  end  only  if  there  exists  a 

1  i 

set  of  vectors  9  c  HI  ,9  >  0,  1  *Q*,  such  that 


(5) 


o  >  9lAi  and  a  <  9ibl 


i  «Q*  . 


Furthermore,  if  F  is  full  dimensional,  Q  is  finite. 
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and  at  yt  0,  than  arx>  at  Is  s  facet  of  conv  F  if  end  only 
if  at  J1  0  Is  a  vertex  of  the  polyhedron 

Ft  •  (a|a  seeisfies  (5)  for  some  9*  >  0,  1  eQ*}. 

The  first  of  these  results  esn  be  used  to  generate 
computationally  inexpensive  cutting  planes  for  a  variety 
of  special  cases  of  F,  corresponding  to  logical  conditions 
inherent  to  the  problem  at  hand;  vhereas  the  second  result 
can  be  used  to  strengthen  any  such  cut.  at  an  increasing 
computational  cost,  up  to  the  point  where  it  becomes  a 
facet  of  conv  F. 

Often  there  is  advantage  in  easting  an  Integer  program 
into  the  form  of  a  disjunctive  program  with  Integrality 
constraints  on  same  of  the  variables.  For  such  problems,  a 
procedure  called  monoldal  cut  strengthening  that  combines 
the  disjunctive  and  subadditive  approaches  can  be  used  to 
derive  a  family  of  cutting  planes  whose  strength  versus 
computational  cost  ratio  compares  favorably  with  cutting 
planes  besed  on  either  approach  taken  separately. 

A  fundamental  question  of  Integer  programming  theory 
is  whether  the  convex  hull  of  feasible  points  can  be 
generated  sequentially,  by  imposing  the  integrality  con* 
ditlons  step  by  step.  That  is,  by  first  producing  all  the 
facets  of  the  convex  hull  of  points  satisfying  the  linear 
inequalities,  plus  the  integrality  condition  on,  say, 
then  adding  all  these  facet  inequalities  to  the  constraint 
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set  and  ganaratlng  Cha  convex  hull  of  points  satisfying 
this  amended  sat  of  inaqua litl as ,  plus  the  integrality  con¬ 
dition  on  x2;  ate.  The  question  also  has  practical  impor¬ 
tance,  since  convex  hull  calculations  for  a  mixed  Integer 
program  with  a  single  lntager  variable  are  much  easier  than 
for  ona  with  many  integer  variables. 

To  be  more  specific,  suppose  ve  wish  to  generate  the 
convex  hull  of  the  set 

X  ■  [x|Ax  >  b,  x  >  0,  Xj  integer,  j  -  l,...,n}. 

Let 

XQ  -  t*lAx  >  b,  x  >  0} 
and  for  j  *  l,...,n,  define  recursively 

Xj  -  conv{x  c  Xj_2|x^  integer}. 

Obviously,  XQCconv  X;  the  question  is,  whether 

X  »  conv  X  ? 
n 

The  answer,  obtained  from  disjunctive  programming 
considerations,  is  that  for  a  general  Integer  program  the 
statement  XQ  -  conv  X  is  false;  but  that  for  a  0-1  program 
it  is  true.  This  is  one  of  the  main  distinguishing  proper¬ 
ties  of  0-1  programs  among  lntager  programs. 

For  lieerature  see  Belas  (1979),  Glover  (1974), 
Jeroslow  (1977). 


Combinatorial  cuts 


Given  s  graph  G  •  (7,  E)  with  vertex  set  7  and  edge 
set  E,  a  matching  in  G  is  a  set  of  pairwise  nonadjacent 
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edges  of  G.  If  A  la  eh*  Incidence  matrix  of  verelces  ver- 
aua  edges  of  G  end  *  weight  w ,  la  assigned  to  every  edge  j, 
Che  problem  of  finding  e  maximum-weight  matching  In  G  is 
the  integer  program 

max(wx|Ax  <  e,  Xj  ■  0  or  l,  J  *E} 
where  *  -  (1,  has  |vj  components,  and  x^  »  1  if 

edge  j  is  in  the  matching,  x^  ■  0  otherwise.  Edmonds  (1965) 
has  shown  Chat  this  problem  can  be  restated  as  a  linear 
program  in  Che  same  variables,  by  adding  an  inequality  of 
the  form 

2zr  <|<|s|  -  D 

for  every  SCV  such  that  js|  is  odd.  Here  E(S)  is  the  set 
of  edges  vlch  both  ends  in  S. 

Unfortunately,  the  matching  polytope  is  the  exception 
rather  chan  the  rule,  and  for  most  combinatorial  problems 
such  a  simple  linear  characterization  of  the  convex  hull 
of  feasible  points  does  not  exist.  However,  certain  classes 
of  facets  of  the  convex  hull  have  been  identified  for 
several  problems. 

The  vertex  packing  problem  in  a  graph  G  »  (V,  E)  with 
vertex-weights  c^,  ieV,  consists  in  finding  a  maximum 
weight  independent  (1.*.,  pairwise  nonadjecent)  set  of 
vertices.  If  A  is  the  same  incidence  matrix  as  before 
end  T  denotes  transposition,  the  vertex  pecking  problem  is 
the  integer  program 
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T 

max{cx|A  x  <  •,  Xj  «  0  or  1,  j  « v] 
where  e  hes  |e|  components  end  x^  ■  1  if  vertex  j  is  in 
the  pecking,  x^  •  0  otherwise.  Let  1(G)  denote  the  pecking 
polytope  of  G,  i.e.,  the  convex  hull  of  incidence  vectors 
of  peckings  in  G. 

Severel  classes  of  facets  of  1(G)  ere  known.  For 

instance,  an  inequality  of  the  form 

(6)  Z  x  <  1 
JcK  J 

is  a  facet  of  1(G)  if  and  only  if  KCV  is  a  clique,  i.e., 
a  maximal  set  of  pairwise  adjacent  vertices  of  G.  The 
class  of  graphs  whose  pecking  polytope  1(G)  is  completely 
described  by  this  family  of  inequalities  (i.e.,  1(G)  hes 
no  other  nontrivial  facets)  is  called  perfect.  A  greph  is 
known  to  be  perfect  if  end  only  if  its  complement  is 
perfect.  The  properties  of  perfect  graphs  and  their  packing 
polyhedra  have  been  intensely  studied  during  the  sixties 
and  seventies  and  have,  among  other  things,  served  as  a 
starting  point  for  a  theory  of  blocking  and  antiblocking 
polyhedra  developed  by  Fulkerson  (1971) . 

More  generally,  many  classes  of  facets  of  1(G)  are 
associated  with  certain  induced  subgraphs  G '  of  G.  When  G ' 
is  Induced  by  a  clique,  the  corresponding  Inequality  (6)  is, 
as  mentioned  above,  a  facet  of  1(G).  Other  induced  sub¬ 
graphs  G '  yield  inequalities  that  are  facets  of  I(G') 
rather  than  1(G),  but  can  be  used  to  obtain  corresponding 
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facets  for  1(2)  through  a  procedure  called  lifting.  For 

ioacaaca,  if  g'  ■  (V ' ,  E ')  is  (i)  an  odd  hole  (i.e. ,  a 

chordless  cycle  of  odd  length),  or  (ii)  the  complement  of 

an  odd  hole,  then 

2  x.  <  k 
jcv'  -1 

is  a  facet  of  1(G),  with  k  -  ±(|v7|  -  i)  in  case  (i),  and 
k  «  2  in  ease  (ii). 

The  above  mentioned  lifting  procedure  is  based  on  the 

following  result.  Let  G 7  be  any  subgraph  of  G  induced  by 

V'cv,  and  let 

£  .  «.*,  <  or 
jcV  J  J  ° 

be  a  facet  of  KG7).  Then  there  exist  integers  (3^ ,  0  <  t , 

<  a  ,  such  that 
o 

E  a.x.  +  >  m  T  0,x  <  a 

J«V  J  J  j«VW7  J  ^  0 

is  a  facet  of  1(G).  The  coefficients  Bj  can  be  calculated 
sequentially,  and  their  values  depend  on  the  particular 
sequence.  These  calculations  involve  the  solution  of  an 
Integer  program  for  each  coefficient,  buc  for  certain 
special  structures  they  become  manageable. 

Other  combinatorial  problems  for  which  several  classes 
of  facets  of  the  feasible  set  have  been  characterised,  in¬ 
clude  the  knapsack  problem,  the  traveling  salesman  problem. 


For  literature  see  the  books  by  Ford  and  Fulkerson 
(1962)  and  Lawler  (1976)  and  the  surveys  by  Bales  and 
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Padberg  (1976),  Hoffman  (1979),  Lova'st  (1979),  Klee  (1980), 
Padberg  (1979). 

Computer  Implementation 

Ac  present  ell  commercially  evelleble  Integer  pro¬ 
gramming  codes  ere  of  Che  branch  and  bound  type.  While 
they  can  sometimes  solve  problems  with  hundreds  of  Integer 
end  thousands  of  continuous  variables,  they  cannot  be 
guaranteed  to  find  optimal  solutions  in  a  reasonable  amount 
of  time  to  problems  with  more  than  30-40  variables.  On  the 
ocher  hand,  they  usually  find  feasible  solutions  of  accept¬ 
able  quality  to  much  larger  problems.  These  conmereial 
codes,  while  quite  sophisticated  In  their  linear  programming 
subroutines,  do  not  incorporate  any  of  the  results  obtained 
in  Integer  programming  during  the  last  decade. 

A  considerable  number  of  specialized  branch  and 
bound/ implicit  enumeration  algorithms  have  been  Implemented 
by  operations  research  groups  in  universities  or  industrial 
companies.  They  usually  contain  other  features  besides 
enumeration,  like  cutting  planes  and/or  Lagrangean 
relaxation.  Some  of  these  codes  can  solve  general  (unstruc¬ 
tured)  0-1  programs  with  up  to  80-100  Integer  variables, 
and  structured  problems  with  up  to  several  hundred  (assembly 

line  balancing,  multiple  choice,  facility  location),  a  few 
thousand  (sparse  set  covering  or  set  partitioning,  general¬ 
ized  assignment),  or  several  thousand  (knapsack  traveling 
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salesman)  0-1  variables. 

Cutting  plane  procedures  for  general  pure  and  mixed 
integer  programs  are  at  presant  too  erratic  and  slow  to 
compete  with  enumerative  methods.  However,  for  a  number  of 
special  structures  (set  covering,  traveling  salesman 
problem)  where  information  available  about  the  convex  hull 
of  feasible  points  has  made  it  possible  to  generate  strong 
inequalities  at  accaptabla  computational  cost,  cutting 
planes,  either  by  themselves,  or  in  combination  with 
enumerative  and/or  Lagrangean  techniques,  have  been  highly 
successful. 

At  the  current  state  of  the  art,  while  many  real  world 
problems  amenable  to  an  integer  programing  formulation  fit 
within  the  stated  limits  and  are  solvable  in  useful  time, 
others  substantially  exceed  those  limits.  Furthermore, 
some  important  and  frequently  occurring  real  world  prob¬ 
lems,  like  job  shop  scheduling  and  others,  lead  to  integer 
programming  models  that  are  almost  always  beyond  the  limits 
of  what  Is  currently  solvable.  Hence  the  great  importance 
of  approximation  methods  for  such  problems. 

For  literature  on  computer  codes  see  Land  and  Powell 
(1979),  Spielberg  (1979). 
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